<body>
Token abstractions that separate the notion of tokens from Strings. This
allows for quick comparisons without doing character-by-character
matching and for storing meta-data such as terminal vs non-terminal
information and performing factored MT.
</body>